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Chapter 1 

Classical measures of smoothness 1 



There exist many different ways of measuring the smoothness of a function /. The most natural one is 
certainly the order of differentiability, i.e. the maximal index m such that /( m ) = (-£) / is continuous. To 
this particular measure of smoothness, we can associate a class of function spaces: if / is an interval of M, 
we denote by C m (T) the space of continuous functions which have bounded and continuous derivatives, up 
to the order m. This space can be equipped with the norm 

||/|| Cro(/) := sup 8up\f®(x)\. (1.1) 

1=0, ••• ,mx£l 

for which it is a Banach space. (That is, the space is a vector space; the norm satisfies the triangle inequality; 
|| / ||= is possible only if / = 0; finally, all Cauchy sequences converge: if we have a sequence with entries 
/„ € C m (I) for which || /„ — /„• || can be made arbitrarily small simply by choosing n,n sufficiently large, 
then the /„ (and all their derivatives up to the mth) converge uniformly to some function / in C m (and its 
derivatives) . 

In the case of a multivariate domain Q, e K d , we define C m (fi) to be the space of continuous functions 

which have bounded and continuous partial derivatives d a f := -^-ai — ^ ad , for |a| := ct\+- ■ - + a.d = 0, • • • , m. 

This space can also be equipped with the norm 

II / llo ( n) == E ^P\d a f(x)\, (1.2) 

I a I < ra 

for which it is a Banach space. 

In many instances, one is somehow interested in measuring smoothness in an average sense: for this 
purpose it is natural to introduce the Sobolev spaces W m,p (f2) consisting of all functions / € LP with partial 

derivatives up to order m in LP . Here p is a fixed index in [l,+oo]. (Recall that || / \\ LP = [/ n |/ {x) \ p ] p if 
p < + 00 and || / \\ L „ = sup xen \f (x) |.) This space is also a Banach space, when equipped with the norm 

\\f\\w^--= ( E W da f\\l*) ■ (!-3) 

\ |a<m / 

Note that the norm for C m spaces coincides with the W m '°° norm. 
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CHAPTER 1. CLASSICAL MEASURES OF SMOOTHNESS 



Chapter 2 

Towards fractional smoothness 1 



All the above spaces share the common feature that the regularity index is an integer. In many applications, 
one is interested to allow fractional order of smoothness, in order to describe the regularity of a function 
in a more precise way. The question thus arises of how to fill the gaps between integer smoothness 
classes. There are at least two instances where such a generalization is very natural: 



• 



In the case of L 2 -Sobolev spaces H m := W m ' 2 and when Q, = R d , we can define an equivalent norm 
based on the Fourier transform, since by Parseval's formula we have the norm equivalence 

2 

II/H2,™- / (i + M) 2m |/MI fa. (2.1) 

J R d 

For a non-integer s > 0, it is thus natural to define the space H s as the set of all L 2 functions such 
that 

2 

|| /!&.== / (1 + M) 2s |/M| dw, (2.2) 



p d 



is finite. 

In the case of C m spaces, we note that sup xen \f (x) — f (x — h)\ < C\h\ if / G C 1 for any h G 
whereas for an arbitrary function / € C°, sup x& o\f (x) — f (x — h)\ might go to zero arbitrarily slow 
as \h\ — * 0. This motivates the definition of the Holder spaceC s , < s < 1 consisting of those / G C° 
such that 

sup\f(x)-f(x-h)\<C\h\ s . (2.3) 

If m < s < m + 1, a natural definition of C s is given by / G C m and d a f G C s ~ m , \a\ = m. It can be 
proved that this property can also be expressed by 

sup\Alf(x)\<C\h\ s , (2.4) 

xeii 

where n > s and AJJ is the n-th order finite difference operator defined recursively by A^/ (x) = f (x) — 
f(x-h) and AfJ (x) = A\ (A^ 1 ) / (x) (for example A\f (x) = f (x) - 2/ (x - h) + f (x - 2h)). 
When s is not an integer, the spaces C s that we have defined are also denoted as W s '°°. The space C^ 
can be equiped with the norm 

II / ll C . ( n) == II / llicc^ + sup \h\' s \\ A%f || LOO( (2.5) 
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4 CHAPTER 2. TOWARDS FRACTIONAL SMOOTHNESS 

Let us give two important instances in which the above spaces appear in a natural way. The first is the study 
of the restriction of a function / (x\, ■ ■ ■ ,Xd) to a manifold of lower dimension, for example the hyperplane 
defined by xj = 0. If g(xi,--- ,Xd~i) = f(x\,--- ,x c ;_ 1 ,0) is such a restriction, then it is known that 
/ € H s (R d for s > | implies that g e H s ~? (E d_1 ). The second one is the study of the Brownian motion 
W (t) on an interval J, for which it is known that W (t) is almost surely in C^~ e for all e > 0. 



Chapter 3 

Besov spaces 1 



The definition of "order of smoothness s in LP" for s non-integer and p different from 2 or oo is more subject 
to arbitrary choices. Among others, one may consider: 

• Sobolev spaces W s ' p defined (if m < s < m + 1) by 

II / Hh- := f II / ll^. P + £ / m{X) l d Z { + y) / ^y) ' (3.1) 

\ \ a \= m J fix!i \ x ~y\ J 

These spaces coincide with those defined by means of Fourier transform when p = 2 (see [33] for a 
general treatment). 

• Bessel-potential spaces H s ' p defined by means of the Fourier transform operator T, 

II / || ff .,, = (II / Ilk + II -^(l + I • I s ) Tf \\ P LP ) " (3.2) 

These spaces coincides with the Sobolev spaces W m ' p when m is an integer and 1 < p < + oo (see 
[3], p. 38), but their definition requires that $7 = K d in order to apply the Fourier transform. 

• Besov spaces B* „, involving an extra parameter q that we define below through finite differences. 
These spaces include most of those that we have listed so far as particular cases. As we shall see, one 
of their main interest is that they can be exactly characterized by multiresolution approximation error, 
as well as from the size properties of the wavelet coefficients. 

We define the n-th order L p modulus of smoothness of / by 

u n (f,t) LP = sup\\ Alf \\ LP{n v (3.3) 

\h\<t y • ' 

where £lh,n := {a; G il ; x — kh e fi, k = 0, • • • , n). Here we measure the "size" of AJJ/ in L p -norm, where 
we restrict to L p (£lh,n) to ensure that all the arguments x — kh occurring in the computation of AJJ/ (x) 
still live in fi. For p,q > 1, s > 0, the Besov spaces B^ consists of those functions / e LP such that 

(2 S, ^(/,2lJ ] > ^' (3-4) 

Here n is an integer strictly larger than s. A natural norm for such a space is then given by 

ll/ll^:=ll/ll^ + ll(2^(/,2^) LP )^ ||^. (3.5) 
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6 CHAPTER 3. BESOV SPACES 

If q = oo, the condition (3.4) simply means that || AJJ/ \\ LP < ChT s for \h\ < 1. For q < oo, the decay 
condition on AJJ/ is slightly stronger, since we require that the sequence (2 SJ a;„(/, 2~- 7 ) ) i be summable. 
The space B^ also represents "s order of smoothness measured in L p "; the parameter q allows a finer tuning 
on the degree of smoothness - one has B!L C Bt, „ if qi < qi - but plays a minor role in comparison to s 
since clearly 

B 'p,<i, c B p 2 ,^ if s i^ s 2, (3.6) 

regardless of the values of q\ and q^. Roughly speaking, smoothness of order s in LP is expressed here by 
the fact that, for n large enough, w n (f, t) LP goes to like O (t s ) as t — > 0. 

Clearly C s = B^ ^ when s is not an integer. It can also be proved that when s is not an integer 
W s,p = B!l . These spaces are different from one another for integer values of s, except when p = 2 in which 
case H s = £>| 2 for all values of s (see [33], p. 38). 



Chapter 4 
Embeddings 1 



Sobolev, Besov and Bessel-potential spaces satisfy two obvious embedding relations: 

• For fixed p (and arbitrary q in the case of Besov spaces), the spaces get larger as s decreases. 

• In the case where Q, a bounded domain, for fixed s (and fixed q in the case of Besov spaces), the spaces 
get larger as p decrease, since || / || LP1 < C\\ f \\ LP2 if pi < p 2 . 

A less trivial type of embedding is known as Sobolev embedding. In the case of Sobolev spaces, it states 
that the continuous embedding 

w si,pi c W S2, P 2 if pi < p2 and Sl - S2 > d(l/pi - l/p 2 ) , (4.1) 

holds except in the case where p 2 = +00 and s 2 is an integer, for which one needs to assume s\ — s 2 > 
d(l/pi — l/p 2 )- For example in the univariate case, any H 1 function has also C 1 / 2 smoothness. In the case 
of Besov spaces the embedding relation are given by 

B pI,pi C B pIp2 if Pi ^ V2 and si - s 2 > d(l/ Pl - l/p 2 ) , (4.2) 

with no other restrictions on the indices si,s 2 > 0. In the case where $7 is a bounded domain, these 
embedding are compact if and only if the strict inequality si — s 2 > d(l/pi — l/p 2 ) holds. The proof of 
these embeddings can be found in [4] for Sobolev spaces and [34] for Besov spaces. 

As an exercise, let us see how these embeddings can be used to derive the range of r such that BJ, ([0, 1]) 
can contain discontinuous functions. If r > 1/2, then there exists e > such that r — 2e > 1/2; We remark 
that B r 2 C B^J^ C B^q ^ = C e , so all functions in B\ „ are continuous. Therefore only B 2 „ with r < 1/2 can 
contain discontinuous functions. In the limiting case r = 1/2, a closer inspection reveals that the functions 

1 /2 1 /2 

in B 2 are continuous if q < 00, while B 2oo includes discontinuous functions, such as the characteristic 
funciton of an interval [0, a] for < a < 1. 
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Chapter 5 

Characterization by approximation 
properties 1 



An important feature of Besov spaces is that they admit equivalent characterization by multiresolution 
approximation properties and by wavelet decompositions. 

Here we use the following standard notation (see [17] or [11] for a general treatment): if / is function we 
denote by Pjf its projection onto the space Vj, and by Qjf = Pj+if — Pjf its projection onto the detail 
space Wj. The multiscale decomposition of / writes 

j>0 

The projectors Pj and Qj can be further expressed in terms of biorthogonal scaling functions and wavelets 
bases: 

p jf ■= J2 < f^ x > ^ x and Qjf := Z) < f^ x > ^ a - ( 5 - 2 ) 

|A|=i |A|=j 

Here we use the simplified notation ip\ with "|A| = j" meaning that the functions are picked at resolution 
j. In the case where fi = M d , these have the general from ip\ (x) := (pj.k (x) := 2 d J' 2 (p {Vx — fc), bur for 
a general domain Q. = M. d proper adaptations of these bases need to be done near the boundary. We can 
therefore write 

f = Y1 dx ^ x > dx :=< f> ^ A >' ( 5 - 3 ) 

where we include in this sum the wavelets at all levels j > and we incorporate the scaling function ip\ at 
the first level |A| = 0. 

Under certain assumptions that we shall discuss below, it is known that the Besov norm || / || B , is 
equivalent to 

||Po/|| 1 >+||(2«'||/-P J -/|| L ,) J .> ||/. ) (5.4) 

or to 

II Pof \\ LP + II (2« || Qif || LP ) .>„ \\e« ■ (5.5) 
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10 CHAPTER 5. CHARACTERIZATION BY APPROXIMATION PROPERTIES 

Using the equivalence || Qjf \\ LP ~ 2( d / 2 ~ d / p ^\\ (<^a) i a|=i II a ^ eacn level to prove a third equivalent norm 
in terms of the wavelet coefficients: 

H (2, J2 W-*/p)J || (d A ) |A|= .||, P ) , >Q \\e, . (5.6) 

These equivalences mean that the modulus of smoothness iii„(/, 2~ J ) in the definition of B'L can be 
replaced either by || / — Pjf \\ LP or by || Qjf \\ LP . Their validity requires that the spaces Vj satisfy the 
following two assumptions: 

• The Vj must satisfy an approximation property that takes the form of a direct estimate 

Wf-PjfWv, <Cu n (f,2-i) Lp . (5.7) 

Such an estimate ensures that a smooth function will have a fast rate of approximation. 

• They must also satisfy smoothness properties that takes the form of an inverse estimate 

w n (fj,t) LP < C[min{l,tV)] n \\ fj \\ LP if /_,• G Vj. (5.8) 

Such an estimate takes into account the smoothness of the spaces Vy. it ensures that a function that 
is approximated at a sufficiently fast rate rate by these spaces should also have some smoothness. 

One can show that the direct estimate is satisfied if and only if all polynomials up to order n — 1 can be 
written as combinations of the scaling functions (f\ in Vj, or equivalently if the dual wavelets ip\ have n 
vanishing moments. On the other hand, the inverse estimate requires that the scaling functions ip\ that 
generates Vj are smooth in the sense of belonging to W n,v . Note that the direct estimate immediately 
implies that the expression (5.4) is less than II / II Ra .A more refined mechanism, using the inverse estimate 

(as well as some discrete Hardy inequalities) is used to prove the full equivalence between II / II Rs and (5.5) 

or (5.6). We refer to chapter III in [11] for a detailed proof of these results. 

These equivalences show that the convergence rate N~ l / d (N = dim (Vj)) can be achieved by the linear 
multiscale approximation process / i— > P/, if and only if the function has roughly "t derivatives in LP". 



Chapter 6 

Besov spaces and nonlinear 
approximation 1 



A natural idea for approximating a function / by wavelets is to retain in the N largest contributions in the 
norm in which we plan to measure the error. In the case where this norm is L p , this is given by 

A N f:= ]T dxi; x , (6.1) 

where En, p (/) is the set of indices of the N largest || d\if)\\\ LP . This set depends on the function /, making 
this approximation process nonlinear. Other instances of nonlinear approximation are discussed in [24]. 

An important result established in [30] states that || / — A ^ f \\ LP ~ N~ r / d is achieved for functions 
/ € B r where 1/q = 1/p + r/d. Note that this relation between p and q corresponds to a critical case of 
the Sobolev embedding of B r into LP. In particular, B r is not contained in Bt, for any e > 0, so that 
no decay rate can be achieved by a linear approximation process for all the functions / in the 
space B r . (For some functions in B\ r , which happen to also lie in spaces for which an independent linear 
approximation theorem can be written, it is of course possible to get a linear approximation rate; the point 
here is that this is possible only via such additional information.) 

Note also that for large values of r, the parameter q given by 1/q = 1/p + r/d is smaller than 1. In such 
a situation the space B s is not a Banach space any more and is only a quasi-norm (it fails to satisfy the 
triangle inequality || x + y ||<|| x \\ + \\ y ||). However, this space is still contained in L 1 (by a Sobolev-type 
embedding) and its characterization by means of wavelets coefficients according to still holds. Letting q go 
to zero as r goes to infinity allows the presence of singularities in the functions of B r even when r is large: 
for example, a function which is piecewise C n on an interval except at a finite number of isolated points of 
discontinuities belongs to all B r for q < 1/s and r < n. This is a particular instance where a non-linear 
approximation process will perform substantially better than a linear projection. 
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